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comprehensive information on ET opportunities and making it easier to acquire 
more career, school, and financial aid information- -was not a strong enough 
intervention to change workers' behavior. LLD did not have an impact on ET 
participation. Younger adults, females, single workers, workers with 
postsecondary degrees, and people with outstanding loans were more likely to 
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Overview: Final Report on the Lifelong Learning 
Demonstration 

• by Larry Buron, Larry Orr, and Satyendra Patrabansh, Abt Associates 



The U.S. Department of Labor initiated the Lifelong Learning Demonstration to test 
strategies for promoting continuing education and training among mature incumbent workers 
(individuals age 25 and over with recent work experience). To encourage investment in 
upgrading skills, the demonstration conducted a targeted public information campaign that 
provided information on the benefits of additional education and training and financial aid 
options — including the then-new Federal Direct Student Loan (FDSL) program and made it 
easier for the target population of mature incumbent workers to obtain information about 
education and training opportunities at local educational institutions. 

A rigorous evaluation with a randomly assigned treatment and control groups was 
conducted to measure the impacts of the information campaign on school enrollments, the 
number of credits earned, the receipt and amount of financial aid, and the receipt and amount of 
FDSLs. The demonstration did not have a statistically significant impact on any of these 
educational outcomes during the two-year follow-up period (1996-98). However, the 
demonstration produced an unusually large and rich data base on this important population, 
including administrative data on earnings, school attendance, and financial aid for a sample of 
over 330,000 mature incumbent workers and, for a subsample of 3,600, personal interviews 
about their education and training experiences during the follow-up period. Thus, the 
demonstration provides a rich source of information for analyzing questions relating to the 
education and training activities of mature incumbent workers. 

One such question is identification of the factors underlying the decision of adult 
workers to acquire additional education or formal training. Consistent with qualitative and 
descriptive findings in prior research, we found that younger adults, females, single (never 
married) workers, and workers with post-secondary degrees are more likely to participate in 
educational activities. We also analyzed the effects of a number of measures that have not: 
been available to previous researchers, including workers’ perceptions of the expected 
benefits of additional education and training; barriers to obtaining additional education (prior 
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school loans, presence of children and young children); factors that could help alleviate the 
financial barriers (high earnings, employer tuition reimbursement programs); and "trigger" 
events (changes in marital status, changes in the presence of children in the household, and 
involuntary job loss). Those who expected benefits that would help them on their current job 
were statistically significantly more likely to participate in an education or training program. 
Adults with outstanding loans were more likely to participate during the follow-up period 
(suggesting that presence of a prior school loan is an indication of a strong taste for 
education), but none of the other measures of barriers or barrier alleviators had a significant 
association with the decision to participate in school. The only trigger event that had a 
significant effect on participation in educational activities was a change from at least one 
child to none living in the household (e.g., when the last child left home), which was 
positively correlated with males’ decision to acquire additional education or training. 

Approximately one sixth of the workers in the follow-up survey sample participated 
in a formal education or training program lasting more than two weeks during the two-year 
follow-up period. Nearly 40 percent of these students attended two-year colleges and a 
quarter went to four-year undergraduate institutions. Students pursued a wide range of 
programs; the most common courses of study were computer and information sciences (21 
percent of all students), business and management (17 percent), and education (12 percent). 
Most attended nights or weekends, and over half took 6 or fewer semester credit-equivalents 
in a spell of education or training. 

Mature incumbent workers bore significant costs to participate in education and 
training. The average cost of tuition was $2,661 during the follow-up period; however, 41 
percent of tuition costs were below $500 and only 14 percent were above $5,000. The most 
important source of assistance in meeting these costs was tuition reimbursement by 
employers; over 40 percent of the students received an average of $2,916 each from this 
source. Over 80 percent of those who applied for government or school financial aid 
received it, but only a small proportion (12 percent) applied for this type of assistance. Loans 
from these sources averaged $5,056 and grants or scholarships averaged $2,430. 
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Executive Summary 



Increasingly competitive global markets and accelerating technological changes have 
increased the need for incumbent workers to regularly upgrade their knowledge and skills, 
not only for their own job security, but also to ensure the competitiveness of U.S. 
companies and the continued success of the economy. In an effort to test strategies for 
promoting continuing education and training among mature incumbent workers (individuals 
age 25 and over with recent work experience), the U.S. Department of Labor (DOL) initiated 
the Lifelong Learning Demonstration. The demonstration included designing and testing a 
targeted public information campaign promoting lifelong learning to mature incumbent workers 
in the Greater Baltimore area. To encourage investment in upgrading skills, the public 
information campaign provided information on the benefits of additional education and training 
and financial aid options — including the then-new Federal Direct Student Loan (FDSL) 
program — and made it easier for the target population of mature incumbent workers to obtain 
information about education and training opportunities at local educational institutions. 

This report presents the findings from the Baltimore-area demonstration on the impact 
of the public information campaign, workers’ decision-making process and barriers to investing 
in additional education, and characteristics of the adult students and their schooling experiences. 



Overview of the Demonstration 

In early 1995, the U.S. Department of Labor (DOL), with the assistance of the 
Maryland Higher Education Commission (MHEC), recruited 12 educational institutions in 
the Greater Baltimore area to participate in the Lifelong Learning Demonstration. These 
institutions’ roles in the demonstration were to provide input to the brochures and 
informational materials used in the public information campaign, to disseminate information 
to workers who expressed interest in their education and training courses, to provide data for 
the demonstration evaluation, and to offer FDSLs as a financing option. These institutions 
were diverse in type, including community colleges, private career schools, and four-year 
colleges and universities. 
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In June 1995, DOL contracted with Abt Associates Inc. and its subcontractors. 

Cygnet Associates and Battelle Memorial Institute, to implement and evaluate the Lifelong 
Learning Demonstration. The demonstration sample of mature incumbent workers was 
identified using a combination of demographic data provided by a national consumer data 
vendor and wage data from Maryland Unemployment Insurance earnings records. Mature 
incumbent workers were defined as individuals people age 25 or older who earned more than 
$1,105 (half time at the minimum wage) in at least six out of eight quarters just prior to the 
first demonstration mailing, including the quarter immediately prior to the mailing. 

To test the effect of the targeted public information campaign using the most rigorous 
methods available, research sample members were randomly assigned to a treatment group 
who received the demonstration brochures and informational materials, and a control group 
who did not. The evaluation was also designed to collect data on the education and training 
experiences of both treatment and control groups over time. Hence, the demonstration also 
provides a rich source of information on the education and training activities of mature 
incumbent workers. 

Over 200,000 people were selected for the main demonstration research sample 
(103,732 for the control group; 104,668 for the treatment group). Two mailings of 
informational brochures were sent to the treatment group, in June 1996 and October 1996. 
Brochure recipients were invited to return a postcard or call a toll-free number to receive 
additional information from any or all of the participating educational institutions. 

Data for the analyses presented in this report were collected from participating 
schools (enrollment and financial aid records), the Maryland Higher Education Commission 
(enrollment records), the Maryland Department of Labor, Licensing, and Regulation (wage 
records), Experian, a national consumer data vendor (demographic and geographic data), and 
a follow-up survey of a subsample of the research sample, conducted approximately two 
years after the first mailing (data on educational activities and perceptions, employment, and 
background characteristics). 
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Impacts of the Demonstration on Educational Outcomes 

The primary objective of the Lifelong Learning Demonstration was to encourage adult 
workers to invest in additional education and training to upgrade their skills and, therefore, 
their productivity and earnings. To test whether this objective was achieved, we estimated 
the impact of the demonstration on school enrollments, the number of credits earned, the 
receipt and amount of financial aid, and the receipt and amount of FDSLs. These outcomes 
were measured over a two year follow-up period for three different universes of education 
and training program: the participating educational institutions, all public educational 
institutions in Maryland, and all education and training programs reported on the follow-up 
survey. For the follow-up survey sample, we also estimated impacts on two intermediate 
outcomes: the percent considering attending a school or training program in the future; and 
the proportion of respondents who report that “finding out what schools offer the programs 
you want” is a big problem. 

The demonstration did not have a statistically significant impact on any of these 
educational outcomes during the two-year follow-up period. We conclude that the 
treatment — a brochure providing comprehensive information on education and training 
opportunities and making it easier to acquire more career, school, and financial aid 
information — was not a strong enough intervention, by itself, to change workers’ behavior in 
such a substantial manner. That is, going back to school can mean a radical change in a 
working adult’s life and it would take a stronger intervention to appreciably increase the 
number of people enrolling in education and training institutions. 

Although the demonstration did not test alternative interventions, consideration of the 
barriers to further education reported by sample members suggests some possible ways to 
strengthen the assistance provided to workers interested in upgrading their skills. For 
example, an intervention focusing on reducing the informational barriers to obtaining 
additional education and training — as the Lifelong Learning Demonstration did — might offer 
the opportunity of free or inexpensive career and academic counseling sessions. To be 
effective, these sessions would likely have to conducted in small groups, or even one-on-one, 
by someone knowledgeable about the job market and educational opportunities in the local 
area. One possibility is to provide counseling over the telephone. Convenience is a major 
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factor for working adults, so the sessions would need to be held at accessible locations and at 
times that are convenient for workers. 

It seems likely that active employer involvement in such a program would 
substantially increase its effectiveness in motivating workers to undertake additional 
education and training. Workers’ employers have detailed knowledge of their existing skills 
and the skills that would increase their productivity on the job. Moreover, employer 
involvement might help to avoid or resolve the conflicts between work and education that 
working students often face. 

In addition to providing information, an intervention might provide financial 
assistance to overcome the time and cost barriers that studies (this study and other research) 
consistently find to be major barriers for adults. To maximize its cost-effectiveness, such 
assistance might be designed to leverage employers’ funds. For example, the government 
might match tuition reimbursement provided by employers to workers who enroll in 
education or training programs. A program aimed at alleviating the lack of time barrier 
might offer partial reimbursement (e.g., a tax credit) to employers who offer paid time off for 
education and training activities. 

Again, these suggestions are entirely speculative, based on the kinds of barriers to 
further education cited by sample members. They would need to be tested rigorously before 
being instituted on a large scale. 

The Decision to Participate in Education and Training Programs 

Although the demonstration did not appear to have an impact on participation in 
education and training, it did produce a wealth of information that can be used to analyze 
questions related to further education and training for mature incumbent workers. The first 
such issue we address in this report is identification of the factors underlying the decision to 
acquire further education. Any policy designed to encourage experienced workers to upgrade 
their skills must be grounded in an understanding of these factors. 

In our review of the literature, we found few authors who attempted to present a 
comprehensive model of the decision-making process of adults considering returning to 
school. Studies by economists tend to focus on education and training as an investment in 
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human capital, emphasizing costs (both out-of-pocket and opportunity costs), economic 
returns, and tastes and preferences. In the non-economic literature, the most complete model 
of the decision-making process is the chain-of-response (COR) model developed in Cross 
(1981). In this report, we interpret the COR model within an economic decision-making 
framework, then develop a multivariate model of the decision-making process using specific 
measures of the general factors suggested by this model. 

The COR model describes the decision to participate in a learning activity as the 
result of a chain of responses. The first link in the chain is personality characteristics and 
attitudes about education (e.g., confidence in academic abilities and motivation for 
achievement). In an economic decision-making framework, this link in the chain can be 
thought of as “tastes and preferences for education.” That is, an individual’s personality 
characteristics and attitude toward education determine how positive they feel about 
participation in an education or training program and thus how large the expected net benefit 
of the activity must be to induce them to participate. 

The second link in the COR model is the goals that individuals may achieve through 
additional education and training and the importance of these goals. An individual’s 
evaluation of the consequences of participation is based on the subjective probability of 
succeeding in the activity, the probability of achieving desired goals if the educational 
activity is successfully completed, and the importance the individual places on these goals. 

In an economic framework, this link in the model can be thought of as the calculation of the 
expected benefits of participation. In the COR model, the first two links determine the 
person’s motivation to participate in education and training activities. 

Life transitions can affect the motivation to participate. Triggering events for life 
transitions include such events as job layoffs, divorce, or the youngest child leaving home. 
These triggering events lead to transitions from one status to another (e.g., from one career to 
another), requiring preparation for a new stage of life. This may increase the benefit of 
learning new skills. 

The third link in the COR model is the barriers and opportunities to participation. 
Barriers include tuition and course-related expenses, informational costs such as finding out 
about programs of interest, the opportunity cost of the time needed to participate, and 
scheduling around work and family responsibilities. Obviously, the fewer the barriers the 
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less motivation that is needed to participate. Likewise, the more motivated a person the more 
barriers they will overcome to participate. In an economic framework, barriers can be 
thought of as the costs of participation. 

In summary, tastes and preferences for education and the expected benefits of 
participation determine the motivation to participate and the level of barriers or costs a person 
is willing to overcome to participate in education and training activities. 

Consistent with qualitative and descriptive findings in prior research, we found that 
younger adults, females, single (never married) workers, and workers with post-secondary 
degrees are more likely to participate in educational activities. We interpret the age effect as 
reflecting the longer payback period for younger workers. The other effects probably reflect 
a combination of tastes for education (females and those with advanced degrees) and lower 
opportunity costs (single workers). Prior research on recent high school graduates finds that 
blacks are less likely than whites to pursue college, but there is no significant differences in 
enrollment rates when family income, socioeconomic status, and academic background are 
controlled for in the model. Like this research on young adults, we found no racial 
differences in participation in formal education and training programs among mature 
incumbent workers in the model that controlled for income and other factors. However, in 
contrast to prior studies, we also found that there were no significant differences in 
participation across racial groups in the study population of mature incumbent workers even 
when we did not control for other background factors. 

We also included in the model several measures of the workers’ perceptions of the 
expected benefits to them of additional education and training. Those who expected benefits 
that would help them on their current job were statistically significantly more likely to 
participate in an education or training program. The other expected benefit variables had the 
hypothesized positive sign, but were not statistically significant. 

Several variables indicating barriers to obtaining additional education (prior school 
loans, presence of children and young children) and variables that could help alleviate the 
financial barrier (high earnings, employer tuition reimbursement programs) were also 
included in the model. Prior research has indicated that having outstanding school loans 
may be a barrier to participation in educational activities. However, our analysis indicates 
that people with outstanding loans were more likely to participate during the follow-up 
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period. This suggests that presence of a prior school loan is an indication of a strong taste for 
education. None of the other measures of barriers or barrier alleviators had a significant 
association with the decision to participate in school. 

As part of this analysis, we tested whether “trigger” events that occur during the 
follow-up period have an effect on participation in educational activities, as suggested by the 
COR model. Triggers events mark the transition from one status to another and can lead to a 
reassessment of the costs and benefits of obtaining additional education and training. The 
trigger events that we measured include changes in marital status, changes in the presence of 
children in the household, and involuntary job loss. The only one of these variables that had 
a statistically significant effect on participation in educational activities was a change from at 
least one child to none living in the household, which was positively correlated with males’ 
decision to acquire additional education or training. 

Finally, we modeled the decision to begin exploring educational opportunities by 
requesting information about local schools in response to the demonstration brochure and the 
subsequent participation in education and training programs by brochure respondents. We 
found that the factors that lead workers to take the first step toward returning to school 
(seeking more information about educational opportunities) tend to be more objective, 
observable characteristics (e.g., age, unemployment) than the factors that determine which of 
these workers actually participate in an education or training program. The factors that 
determine which of these workers ultimately participate is likely a combination of unmodeled 
factors and the idiosyncrasies of individual situations. 



Characteristics of Students and Their School Experiences 

Approximately one sixth of the workers in our sample of mature incumbent workers 
in Greater Baltimore participated in a formal education or training program lasting more than 
two weeks during the two-year follow-up period. This figure does not include on-the-job 
training and training provided by the employer at the job-site. 

Nearly three-fourths of these students had at least some college education at the 
beginning of the follow-up period, over half were married, and a similar proportion were over 
the age of 35. More than 70 percent of the students worked for employers who offered 
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tuition reimbursement. Consistent with the results of our analysis of the education decision- 
making process, the students tended to be younger and more highly educated than non- 
students, and were more likely to be female, single, and to have an outstanding school loan. 
Students were quite similar to other mature incumbent workers in their racial composition, 
presence of children in the household, and earnings in the pre-school period. 

Nearly 40 percent of the students attended two-year colleges. A quarter went to four- 
year undergraduate institutions and a sixth enrolled in graduate programs. Private career or 
training institutions accounted for 1 9 percent of the students, with another 7 percent attending 
training courses provided by community-based organizations. 

Students in the sample pursued a wide range of programs, with courses in computer 
and information sciences (21 percent of all students), business and management (17 percent), 
and education (12 percent) the most common areas of study. Most attended nights or 
weekends, and over half took less than 6 semester credit-equivalents in a spell of education or 
training. Over half graduated or completed their program during the follow-up period, and 
more than a third received a degree or certificate, most commonly a professional certificate or 
post-high school training certificate. Thirty percent were still enrolled at the end of the 
follow-up period; only 15 percent had not completed their program and were no longer 
enrolled. 

Mature incumbent workers bore significant costs to participate in education and 
training. The average cost of tuition was $2,661 during the foilow-up period; however, 4l 
percent of tuition costs were below $500 and only 14 percent were above $5,000. In 
addition to tuition costs, students paid an average of $259 for books and course materials and 
$19 per week in travel costs. The cost of child care arrangements for students who used paid 
child care varied from $70 to $1 1 1 per week. 

The most important source of assistance in meeting these costs was tuition 
reimbursement by employers; over 40 percent of the students received an average of $2,916 
each from this source. Over 80 percent of those who applied for government or school 
financial aid received it, but only a small proportion (12 percent) applied for this type of 
assistance. Loans from these sources averaged $5,056 and grants or scholarships averaged 
$2,430. 
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Students reported that they had to make a number of lifestyle adjustments in order to 
participate in education or training. The most commonly cited sacrifices, each named by 
more than 60 percent of the students, were reductions in the time available for leisure time 
activities and to spend with their families and friends. Smaller proportions reported cutting 
back on leisure activities or major purchases in order to save money for school. Only about a 
quarter reported that they had to reschedule their work hours in order to attend courses, and a 
sixth said that they had to reduce their work hours. 

When asked to identify the most important services that schools could provide for 
working students, about equal numbers named job placement assistance, career counseling, 
academic counseling, and assistance in learning about and applying for financial aid. Nearly 
three quarters felt that it was very important that these services be available on weekends and 
at night during the week. The school loan features most frequently cited as very important 
were those that make the process less cumbersome and time-consuming: having a single 
application for all types of Federal assistance, loan consolidation, and direct disbursement of 
government checks to the school. Smaller, but still substantial proportions of students (35 to 
45 percent) felt that flexible repayment options, such as income-contingent repayment, 
extended repayment, and tiered repayment, were very important loan features. 
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Chapter 1 
Background 



Increasingly competitive global markets and accelerating technological changes have 
increased the need for incumbent workers to regularly upgrade their knowledge and skills, not 
only for their own job security, but also to ensure the competitiveness of U.S. companies and 
the continued success of the economy. As new companies form and existing companies 
downsize or otherwise realign themselves to meet the demands of the international market place, 
few people have the option of working for one company in a steady career path for their entire 
working life. Instead, workers must be prepared to change jobs, or even occupations, several 
times during their career. Hence, workers will need to be better educated to fill new jobs and to 
adapt to the changing knowledge and skill requirements of existing jobs. Likewise, in this 
dynamic marketplace, employers need workers who can fill the new jobs and who can adapt to 
the changing requirements of existing jobs so that companies can grow or realign themselves in 
reaction to market opportunities. With regular enhancement of workers’ knowledge and skills 
to meet the increased flexibility and autonomy of today’s workplace, economic growth will not 
be slowed by a mismatch of employer needs and worker skills. 

In an effort to test strategies for promoting continuing education and training among mature 
incumbent workers (individuals age 25 and over with recent work experience), the U.S. 
Department of Labor (DOL) initiated the Lifelong Learning Demonstration. The demonstration 
included designing and testing a targeted public information campaign promoting lifelong learning 
to mature incumbent workers in the Greater Baltimore area. To encourage investment in upgrading 
skills, the public information campaign provided information on the benefits of additional 
education and training and financial aid options — including the then-new Federal Direct Student 
Loan (FDSL) 1 program — and made it easier for the target population of mature incumbent workers 
to obtain information about education and training opportunities at local educational institutions. 



' The Federal Direct Student Loan program was authorized in 1993. Under this program, loans are made directly to 
students by the government, instead of the government guaranteeing bank loans to students as under previous federal loan 
programs. 
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This report presents the findings from the Baltimore-area demonstration on the impact of 
the public information campaign, workers’ decision-making process and barriers to investing in 
additional education, and the characteristics of mature incumbent workers who participate in 
training or educational activities and their educational activities. 

Demonstration Overview 

The timing of key implementation steps in the Lifelong Learning Demonstration is 
depicted in Exhibit 1-1. In March and April of 1995, DOL with the assistance of the Maryland 
Higher Education Commission (MHEC), 2 began recruiting educational institutions from a 
comprehensive list of Maryland two- and four-year public colleges and universities, and private 
career schools to participate in the demonstration. Educational institutions had to meet only a 
few criteria to be able to participate in the Lifelong Learning Demonstration. They had to be 
willing to provide input to the brochures and informational materials, disseminate information 
to interested brochure respondents, and provide data for the demonstration evaluation. Finally, 
because the demonstration was not only intended to generate additional enrollments among 
mature incumbent workers, but also to encourage the use of Federal Direct Student Loans 
(FDSLs) as a financing option, educational institutions were also required to participate in this 
then-new loan program in order to be eligible for inclusion in the demonstration. 3 By September 
1995, DOL had obtained the participation of twelve educational institutions in the Lifelong 
Learning Demonstration. As shown in Exhibit 1-2, participating educational institutions were 
diverse in type, including community colleges, private career colleges, and four-year colleges and 
universities. 



Contact with MHEC was made with the support of the Maryland Department of Labor, Licensing, and Regulation 
(formerly the Department ot Economic and Employment Development). 

] An educational institution that was not participating in the FDSL program at that time, but was interested in participating 
in the demonstration was not immediately deemed ineligible. Instead, DOL secured the assistance of the U.S. Department 
of Education to enroll them in the loan program. The U.S. Department of Education had begun phasing in the FDSL 
program in the Baltimore area, but made special accommodations for schools wishing to participate in the demonstration. A 
tew schools took advantage of demonstration participation as a way to convert to the direct lending program. 
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Exhibit 1-1 

Timing of Key Implementation Steps 
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Exhibit 1-2 

Participating Educational Institutions, by Type 



Community Colleges 


Private Career Schools 


Four-Year Colleges and 
Universities 


Catonsville Community College 
Dundalk Community College 
Essex Community College 


Medix School 
Fleet Business School 
TESST Technology Institute 
(formerly Arundel Institute 
of Technology) 


Coppin State College 

Johns Hopkins University 
School of Continuing 
Studies 

Loyola College in Maryland 
Towson State University 






University of Maryland 
Baltimore County 






University of Maryland 
University College 



In June 1995, DOL contracted with Abt Associates Inc. and its subcontractors, Cygnet 
Associates and Battelle Memorial Institute, to implement and evaluate the Lifelong Learning 
Demonstration. The demonstration project tested the effects of providing comprehensive 
information on education and training opportunities, including expedited referrals to local 
educational institutions, on the subsequent education and training activities and labor market 
success of mature, incumbent workers. The demonstration consisted of two phases, the pilot 
demonstration and the main demonstration, and was conducted between November 1995 and 
March 1997. 

The demonstration sample of mature incumbent workers was identified using a 
combination of demographic data provided by a national consumer data vendor and wage data 
from Maryland Unemployment Insurance earnings records. 4 Mature incumbent workers were 
defined as individuals age 25 or older who earned more than $1,105 (half time at the minimum 
wage) in at least six out of eight quarters just prior to the first demonstration mailing, including 
the quarter immediately prior to the mailing. To be eligible, demonstration sample members had 



4 See Appendix A for a description of each of these data sources and how they were used to identify demonstration sample 
members. 
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to live in the area from which at least one of the participating schools normally drew their 
students, Baltimore City and the five contiguous counties. 

Information was provided directly to the target population through brochures and other 
informational materials mailed to them. To determine what informational materials might 
generate the greatest response among mature incumbent workers, Abt Associates and its 
subcontractor, Cygnet, designed four different sets of direct mail brochures, which were tested 
in the pilot phase. The brochure and informational materials for the main demonstration were 
- selected on the basis of the results from the pilot. In the main demonstration, brochure recipients 
had the option to request information from any or all of the 12 educational institutions 
participating in the demonstration. These requests were referred to the educational institutions, 
who then sent program and/or admissions information to the respondent. Respondents were also 
sent The Student Guide, Financial Aid from the U.S. Department of Education, a booklet that 
describes the various types of federal financial aid available; and the Self-Starter Guide for Adult 
Learning, developed by Cygnet Associates for the demonstration, which reviews labor market 
trends and programs of study offered at participating educational institutions, and guides the 
individual through a self-assessment of career goals and financial needs. In an attempt to 
strengthen the effectiveness of the targeted public information campaign and allow ample 
opportunity for mature incumbent workers to pursue additional education or training, the main 
demonstration mailing was sent twice, once in June 1996 and again in October 1996. Requests 
for information were fulfilled for a nine-month period following the initial mailing. 5 

To test the effect of the targeted public information campaign using the most rigorous 
methods available, research sample members were randomly assigned to treatment groups who 
received the brochures and informational materials, and control groups who did not. Over 
200,000 people were selected for the main demonstration research sample (103,732 for the 
control group; 104,668 for the treatment group). Random assignment generates treatment and 
controfgroups that are similar in all respects (including unobservable characteristics), except 
for one variant — the treatment groups received the informational materials. Therefore, any 
systematic difference in rates of pursuit of education or training can be attributed to the targeted 



5 The Interim Report (Buron et at, 1998) contains an analysis of the implementation process including information on the 
timing and types of information requested by brochure respondents. It also contains copies of the main demonstration 
brochure and the Self-Starter Guide for Adult Learning. 
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public information campaign. The evaluation was also designed to collect data on the education 
and training experiences of both treatment and control groups over time. Hence, the 
demonstration also provides a rich source of information on the education and training activities 
of mature incumbent workers. 

Report Overview 

This is the second of two reports evaluating the effect of the targeted public information 
campaign. In the first report, we provided detailed information on demonstration operations, 
including recruitment of educational institutions, sample selection, the design of the brochures 
and informational materials, and procedures for responding to inquiries generated by the public 
information campaign. We also provided a descriptive assessment of responses to the campaign 
and preliminary estimates of the impact of the demonstration. Here, we will extend the impact 
analysis using a longer follow-up period and more comprehensive data, but otherwise do not 
repeat the information in the Interim Report at the same level of detail. 

This report is organized as follows. Chapter Two first assesses the comparability of the 
treatment and control groups to demonstrate the integrity of the random assignment procedures 
then presents estimates of the impacts of the targeted public information campaign on 
enrollment, credit hours earned, and receipt and amount of financial aid at participating 
educational institutions. We supplement this analysis with information from two other data 
sources: an analysis of the impact of the demonstration on enrollment and credits at all Maryland 
public post-secondary institutions, using data from the Maryland Higher Education Commission; 
and an analysis of the impact of the demonstration on enrollment, credits earned, receipt and 
amount of financial aid, plans to obtain additional education or training in the future, and 
informational barriers to investing in additional education, using data from a follow-up survey 
of a subsample of demonstration members. 6 Chapter 3 contains an analysis of the decision to 
return to school, including perceptions of the value of education, barriers to returning to school, 
and a multivariate model to distinguish important factors in the decision to return to school. 



6 The survey sample was selected using a disproportionate stratified sampling design (students and brochure respondents 
were oversampled), then estimates were weighted to reflect the same universe as the entire demonstration sample, mature 
incumbent workers in the Greater Baltimore area. See Appendix A for a full description of the survey sample design and 
survey content. Appendix E contains a copy of the survey. 
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Chapter 4 describes the characteristics of students and their schooling experience, including area 
of study, credits earned, degree sought and earned, and time of classes. It also examines barriers 
students overcame in order to participate, including education-related expenses and the use of 
financial aid, lifestyle adjustments, and perceptions of the importance of selected school services 
and financial aid features. Both Chapter 3 and 4 rely on information collected in the Lifelong 
Learning Demonstration Follow-up Survey for a subsample of 3,601 respondents. 
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Chapter 2 



Impacts of the Demonstration on Educational 

Outcomes 



The primary objective of the Lifelong Learning Demonstration was to encourage adult 
workers to invest in additional education and training to upgrade their skills and, therefore, their 
productivity and earnings. This chapter presents results regarding the effects of the 
demonstration on participation in education and training programs and courses during a two-year 
follow-up period. 

To encourage investment in upgrading skills, the public information campaign provided 
adult workers with information on the benefits of additional education and training, made it 
easier for them to obtain information on educational opportunities at local institutions, and 
informed them about financial aid options, including the Federal Direct Student Loan (FDSL). 
The most direct potential impacts of the demonstration are on educational investments and the 
use of financial aid. Thus, the primary outcomes we investigate in this report are school 
enrollments, the number of credits earned, the receipt and amount of financial aid, and the receipt 
and amount of FDSLs. For a subsample (those selected for the follow-up survey), we also 
estimate impacts on two intermediate outcomes: the percent considering attending a school or 
training program in the future; and the proportion of respondents who report that “finding out 
what schools offer the programs you want” is a big problem. This is the type of barrier that the 
public information campaign was intended to help adult workers overcome. 

We use data from multiple sources for the impact analysis. Outcome measures are from 
participating educational institutions’ administrative records data provided by the Maryland 
Higher Education Commission (MHEC) for the entire main demonstration sample of over 
200,000 people, and data collected through the Lifelong Learning Demonstration Follow-Up 
Survey for the subsample of 3,601 respondents. Ten out of the 12 participating institutions 
provided data on education and financial aid outcomes for the baseline period and for two years 
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after the start of the demonstration (Summer 1996 through Spring 1998 academic terms). 1 In 
addition to the outcome data from participating institutions, we also have data from the Maryland 
Higher Education Commission (MHEC) on enrollments and credits attempted in the Fall 1996 
and Fall 1997 terms at all Maryland public post-secondary institutions. A third source of data 
is the Lifelong Learning Demonstration Follow-Up Survey administered by Abt Associates 
between May and December 1998. The survey provided data on education and financial aid 
outcomes during the follow-up period (July 1996 to June 1998) as well as respondents’ 
perceptions of barriers they face in considering additional education and training. Finally, we 
use demographic data from Experian and earnings data from the Maryland Department of Labor, 
Licensing, and Regulation (DOLLR) to control for the baseline characteristics of the sample 
when estimating impacts. (See Appendix A for a full description of all the data sources.) 

The first section of this chapter describes the characteristics of the adult workers in the 
main demonstration sample. 2 In the second section, we present the estimated overall impacts 
of the demonstration on educational outcomes at participating educational institutions, all 
Maryland public educational institutions, and at all institutions attended by the survey 
respondents. In this section, we also investigate impacts on subgroups of the sample defined by 
age, gender, race and predemonstration earnings, education, presence of children in the 
household, and school loan burden. The final part of this section summarizes our findings. 

Characteristics of Sample Members 

A key element of the demonstration design was the assignment of sample members to 
treatment and control groups. If the design and procedures for randomly assigning eligible 
workers to treatment and control groups were done correctly, then the workers in the two groups 
should be comparable and we can rely on differences in their outcomes to represent the impact 



1 Two of the schools that participated in the demonstration, Coppin State College and University of Maryland University 
College, did not provide data for this report. A third participating school, Johns Hopkins University, only provided data 
from its School of Continuing Studies (the School that focuses on adult learners and responded to demonstration referrals) 
for the baseline and first follow-up year. In addition, usable financial aid data were not available from Johns Hopkins 
University in the baseline and first follow-up year. 

2 Appendix D contains similar descriptive information for students at participating schools compared to other adult workers 
(i.e., non-students). It also contains descriptive information on the schooling experiences of the students who attended 
participating institutions. 
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of the demonstration. A comparison of predemonstration demographic, geographic, and 
economic characteristics of treatment and control group members did not uncover any 
statistically significant differences between the two groups. Hence, we conclude that the 
treatment and control groups are, in general, valid experimental comparison groups. The results 
of this comparison are shown in Exhibit 2-1 and discussed below. 3 

As can be seen in the first panel of Exhibit 2- 1 , the mature incumbent workers in our 
sample cover the entire range of ages 25 and above, with almost half in the 36 to 49 age range. 
A slight majority of the sample members are males (53 percent). The most common area of 
residence is Baltimore County (the most populous area in our sample) containing about one-third 
of the sample members, with Baltimore City (21 percent) and Anne Arundel County (19 percent) 
being the next most common areas of residence. Median UI earnings in the year prior to the 
demonstration was $30,850, with 12 percent earning less than $15,000 and 6 percent earning 
more than $75,000. Finally, as shown in the bottom panel, only 2 percent of the sample 
members were enrolled in a participating educational institution the semester prior to the first 
demonstration mailing (Spring 1996). 

Impacts of Lifelong Learning Demonstration 

In this section, we report our estimates of the impact of the Lifelong Learning 
Demonstration. First, we discuss the hypothesized impacts of the demonstration and our 
methodology for estimating impacts. We then present our impact estimates for the entire sample 
at participating institutions, for the entire sample at all Maryland public educational institutions, 
and for the follow-up survey sample at any education and training institution. Following that, 
we present our impact estimates for subgroups of the overall sample at participating institutions 
and of the survey sample. 



3 In addition to the characteristics shown in Exhibit 2-1, we compared the treatment and control groups on measures of 
estimated household income, marital status, and presence of children from the Experian data. These variables are not 
included in the exhibit because Experian data did not distinguish between missing data on these measures and unmarried or 
no children in the household, thus each variable was technically missing data for one-half to two-thirds of all sample 
members. Nevertheless the distributions of these variables (including missing values) were virtually identical for the 
treatment and control groups. 
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Exhibit 2-1 

Characteristics of the Treatment and Control Group Members 



Characteristic 


Control Group 


Treatment Group 


Age in 1996 n s ■ 


25-35 


28% 


28% 


36-49 


48 


48 


50+ 


25 


25 


Gender** 


Male 


53% 


53% 


Female 


47 


47 


City/county n s ■ 


Anne Arundel County 


19% 


19% 


Baltimore City 


20 


21 


Baltimore County 


35 


34 


Carroll County 


7 


7 


Harford County 


10 


10 


Howard County 


10 


10 


Ul Earnings, 1994 Q4 to 1995 03 0 5 
<$15,000 


12% 


12% 


15,000-24,999 


24 


24 


25,000-34,999 


23 


23 


35,000-49,999 


23 


23 


50,000-74,999 


12 


13 


75,000+ 


6 


6 


Median Ul Earnings n 5 


$30,850 


$30,870 


Attended participating institution(s) 


2% 


2% 


in semester before mailing n s ' 



Sources: Maryland State Unemployment Insurance records (earnings); Administrative records of participating schools (attendance 

in prior semester; Experian data (all other characteristics) 

Sample Definition: Entire main demonstration sample 

Sample Size: 208,400 (control, 103,728; treatment: 104,672); Actual sample sizes vary slightly across cells due to missing data for 

characteristics. 

Notes: indicates treatment-control difference is not significantly different at . 10 level (chi-square test). Column percentages 

for characteristics may not add up to 100 percent due to rounding. 





Impacts of the Demonstration on Educational Outcomes 



Abt Associates Inc. 



2-4 



Hypothesized impacts of the demonstration. The demonstration was a public 
information campaign targeting currently-employed adults with strong labor force attachment 
(see Chapter 1 for an exact definition of the sample). The purpose of the campaign was to 
encourage workers to invest in further education and training by explaining the potential benefits 
and by reducing the cost and time required to find out about education and financial aid options. 
The public information campaign: 

• provided information on the benefits of obtaining additional education or training; 

• simplified the exploration of educational options by furnishing information on 
programs at 12 area institutions that might appeal to adult workers, as well as 
providing an easy way to get more information on opportunities at these institutions; 

• made available a guide for career and education planning; and 

• made available an information guide to federal financial aid sources. 

By making this information readily available, the demonstration intended to reduce the 
informational cost of getting additional education and training. Hence, the most direct potential 
impact of this demonstration is increased enrollment in education and training institutions during 
the follow-up period. This is the first outcome measure we analyze. In addition to encouraging 
new enrollments, it is also possible that the demonstration might encourage adults to take more 
classes than they otherwise would — both by increasing the number of new enrollees and by 
encouraging all enrollees to take more classes than they would have taken in the absence of the 
demonstration. Our second outcome measure, therefore, is the number of semester credits 
earned in the follow-up period. 

The demonstration also informed targeted workers about financial aid options, including 
FDSLs, available at participating institutions. With this additional information and potentially 
new enrollees, it is possible that targeted workers would be more likely to apply for and receive 
financial aid, especially a FDSL, during the follow-up period. To test this hypothesis, we 
analyze receipt of any financial aid, amount of financial aid received, receipt of a FDSL, and the 
amount of FDSLs received. 

Even if the demonstration is not shown to impact actual enrollments and financial aid 
use, it is possible that it had an impact on intermediate outcomes. For the survey sample, we 
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analyze impacts for two potential intermediate outcomes. First, one of the barriers the public 
information campaign was intended to help overcome was the difficulty of acquiring 
information about programs available at local education and training institutions. Thus, we 
analyze the impact of the demonstration on the proportion of respondents who reported that 
“Finding information about what schools offer the programs you want” was a barrier to 
additional investment in education and training. Second, prior research (e.g., Aron and 
Nightingale, 1995) has shown that the decision to go back to school is a prolonged one, often 
taking several years before it is realized. Therefore, we also analyze the impact on the proportion 
of respondents who reported that they were considering participation in education and training 
programs in the next few years. 

Before discussing the specific estimates, the next section describes the methodology used 
to estimate impacts. 

Measuring impacts. As discussed in Chapter 1 , the Lifelong Learning Demonstration 
is a controlled experiment with sample members randomly assigned to a treatment group that 
received brochures promoting education and training and offering further information about local 
educational institutions and student financial aid, and a control group that did not receive this 
information. This design produced treatment and control samples with highly similar 
characteristics (see Exhibit 2-1). Thus, statistically significant differences in average outcomes 
between the two groups can be attributed to the impact of the public information campaign. That 
is, a simple comparison between sample means indicates whether or not the demonstration had 
an impact. 

In this report, we use a more precise framework for estimating impacts, a regression 
analysis that controls for individual-level characteristics. This approach increases the precision 
of the estimated treatment effects, while still providing unbiased impact estimates. We estimate 
impacts using an ordinary least squares framework, controlling for demographic characteristics, 
predemonstration UI earnings, and education-related activities in the semester prior to the 
demonstration. 4 Our estimation methodology is discussed in more detail in Appendix B. 



Strictly speaking, the ordinary least squares method (or linear probability model) is not appropriate for estimating impacts 
on binary outcome variables such as whether or not the person enrolled during the follow-up period, because in extreme 
cases the predicted probability can lie outside the 0 to 1 range. We use this approach for all outcomes, however, because it 
provides much more easily interpreted measures of impact than alternative techniques. We also used the technically correct 
logit analysis framework to estimate impacts on binary outcomes and obtained estimates of the same sign and significance as 
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